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Relationships Matter! 


Why are we here? 


Bullying is a real problem! 


¢ Definition: An intentional act of aggression, based on an imbalance 
of power, that is meant to harm a victim either psychologically or 
physically. Bullying usually occurs repeatedly and over time, but 
sometimes can be identified in a single event. 


¢ Over 50% of kids say someone has said mean or hurtful things to 
them online. 


¢ Over 50% of kids admit saying something mean to another person 
online. 


We have a responsibility to provide students with tools so they can be 
both psychologically and physically safe online and in everyday life. 


Overview 


¢- Forming the Facebook/Yale relationship 
¢ The original report flow 

¢ Ideas for improving the report flow 

¢ Methods for developing new flow 

- The new report flow (v1.1) 

- What do the data say? 

- Next steps 


Facebook / Yale 


- Compassion Day 1 


¢ Initial conversations about Facebook’s needs 
and what the Yale team could provide 


Original Report Flow 


Is this post about you or a friend? 


Yes, this post is about me or a friend: 


) | don't like this post 


It's harassing me 
@ it's harassing a friend 


No, this post is about something else: 


© Spam or scam 
. Hate speech 


. Violence or harmful behavior 
Choose a type >| 


) Sexually explicit content 


. My friend's account might be compromised or hacked 


Send Message 


Enter the Facebook friend you want to contact here. If the friend is not on 
Facebook, you can enter an email address. 


To: | Someone you trust 


Message: | Hi, this person is bothering me online and I'm not sure how 
to respond. Can you please help? 


Jake Brill >» Clive Jakob 
[@2 72:0] 


February 8 at 7:04pm near San Francisco - 28% 


What You Can Do 


if you are in physical danger, please contact a local authority right away. 


W Block Jake Brill 
You and Jake will no longer be able to see each other or connect on 
Facebook 

|_| Get help from an authority figure or trusted friend 
Forward this post to someone who can help you in person 


|_| Report to Facebook 


What You Can Do 


Is your friend in physical danger? If so, please report this threat to a local 
authority. 


\_) Message Clive Jakob to remove 
Ask Clive to remove the video 
(*) Unfriend Clive Jakob 


\_) Block Clive Jakob 


You and Clive will no longer be able to see each other or connect on 
Facebook 


|_| Report to Facebook 


Ideas for improving report flows 


- Infuse developmental science 
13/14 year olds are different from high school and college students 
- Use more kid-friendly language 
“Report” vs. “This post is a problem” 
- Enhance logic of the flow 
‘What happened?’ to ‘how are you feeling?’ to ‘what can you do?’ 
- Differentiate the experience so we could tailor support 
Move from just “harassing me” to real experiences of this age group 
- Empower youth to take a positive and safe action 
Provide simple, effective guidance (e.g., “don’t be alone with this person”) 
- Help youth to get more help from their community 


Encourage kids to reach out to a trusted adult 


Methods for developing new flows 


- Iterative process between Yale Team and Facebook Team: 
Review of existing research 
Focus groups with diverse students in public and private schools 
Interviews with children who experienced cyberbullying 
Interviews with parents, school principals, teachers, and counselors 
Integration of best clinical practices 


Taking Facebook design into consideration (e.g., writing, editing, and making sure we 
got everything we possibly could into the limited space). 


Focus Groups and Interviews 


Participants 


Public and private school students (N = 50; 13 to 15 year olds; 8 groups total) from diverse backgrounds (east and west coast) 


¢ Takeaways from focus groups and interviews 


Kids were particular about the language we used 


E.g., report — meant ‘authority’ or ‘trouble’ or ‘evaluated,’ ‘get help’ suggested ‘technical 
problem’ 


Kids helped us to differentiate the bullying experiences 
Kids wanted Facebook to do something about it, but were not sure what 


If questions were meaningful and kids believed they would be helpful, they would be more 
motivated to complete the flow 


Kids said they wanted help crafting messages 


Kids said not everything needed to be reported b/c they would just tell their friend... 


Focus Groups and Interviews 


Takeaways from interviews with parents 
Parents were mixed on whether they should be the trusted adults 
(Some) parents enabled kids to fake their age 


Parents wanted more resources for their kids to get help 


Our own takeaway 
Had to be a balance between what kids wanted and what we believed they need 
Threatened — may not want to tell trusted adult, but they need help 


We needed to provide children with more direct help 


The new Report Flow (v 1.1) 


Hide story 


This story is a problem 


Who is this post about? 


We are going to ask you some questions so we can find out more about the 
situation and help you. 


First, who is this post about? 


( ) Me 
( ) Someone | know 


(_) It's not about anyone | know, but makes me uncomfortable. 


The new Report Flow (v 1.1) 


If “makes me uncomfortable,” go into Community Standards flow 


Report Post 


What best describes why this makes you uncomfortable? 


() Spam or scam 
(_) Hate speech 
. | Violence or harmful behavior 


| ) Sexually explicit content 


| . | My friend's account might be compromised or hacked 


The new Report Flow (v 1.1) 


However, if 
“about me” or 
“someone I know,” 


go into... We are going to continue to ask you some questions, but if you feel 
suicidal or feel like hurting yourself, please get help now. 


What happened to you? 


Jedediah: 

|_| posted something that I just don't like. 

__| posted a photo of me that makes me very uncomfortable. 
|_| said mean things to me or about me. 

| won't leave me alone. 


|_| threatened to hurt me. 


Let us know the details of what happened here. 


The new Report Flow (v 1.1) 


If “threatening,” we lead to social resolution with extra messaging about safety: 


What do you want to do? 


We care about your safety. No one has the right to physically threaten you. 


Please get help from a trusted friend, adult, or an authority figure 
immediately. 


Here are some things you can do to help handle the situation: 
|) & unfriend Jake Brill 
You'll be removed from each other's friends list. 


CB cer help from someone you trust. 


Let someone know that Jake's photo makes you uncomfortable and 
you want help. 


The new Report Flow (v 1.1) 


If “posted something | don’t like,” send message with pre-populated text: 


What do you want to do? 


a Send a message to Jedediah 


Let Jedediah know that this post makes you uncomfortable and that 
you want it removed. 


Jedediah, 
| saw this posted and | really don't like it. Can you please take it 
down? 


‘continue oan 


The new Report Flow (v 1.1) 


Other options (e.g.,“uncomfortable” / “said mean things” / “won’t leave me 


alone’”’) lead to emotions slide: 


How does this make you feel? 


Tell us more about how this photo made you feel. Please choose how much 
you felt about each emotion below. 


Sad: ( ) not at all 
Nervous: ( ) not at all 
Afraid: ( ) not at all 
Angry: ( ) not at all 
Embarrassed: ( ) not at all 


( Ja little 
( )a little 
( Ja little 
( Ja little 
( Ja little 


_) very 
__) very 


very 
very 
_) very 


( ) extremely 
( ) extremely 
( ) extremely 
( ) extremely 
( ) extremely 


The new Report Flow (v 1.1) 


After identifying emotion, lead to social resolution with text/options that vary as 
a function of the situation and intensity of emotion: 


What do you want to do? 
it's never ok for someone to bother you, or worse, stalk you. 
Here are some things you can do to help handle the situation: 


_| & unfriend Jake Brill 
You'll be removed from each other's friends list. 


C A cer help from someone you trust. 


Let someone know that Jake's photo makes you uncomfortable and 
you want help. 


You could also: 


# Ask Jake to stop bothering you - he might not realize how much it 
upsets you. 


= Block Jake if he continues to bother you on Facebook. 


The new Report Flow (v 1.1) 


Similarly, the option to message someone you trust is pre-populated with text 
that also varies as a function of the situation and intensity of emotion: 
Send Message 


Enter the Facebook friend you want to contact here. If the friend is not on 
Facebook, you can enter an email address. 


To: Someone you trust 


Message: | Summer posted a picture that makes me very uncomfortable. 
i want Summer to take it down. I need your help to figure out 
the best way to handle this. 


By Summer Huff 


The new Report Flow (v 1.1) 


Thank you slides are differentiated by experience 


Thanks For Your Report 


We're sorry that you've had this experience. We'll review this photo and if it 
violates our Community Standards, we'll remove it. 


No one should post a picture of you that makes you uncomfortable. 
Everyone deserves to be treated with respec 
thing by reporting this post. You could also 
trusted adult, like a parent or teacher, in pe 


We have received your report. 


it's important that you always take a threatening post seriously. No one has 
the right to threaten to hurt you, and a true friend would never do this. 


You did the right thing by reporting this post. It might also help to: 


=» Make sure you're never alone with this person. 


=» Go talk to a a trusted adult, like a parent or teacher, in person. 


» Don't send messages to the person - it can make the situation worse. 


Your safety is very important to us. 


What do the data say? 


“The post is a problem” 5/25-6/03 
23600 (unique users) 


66%/34% 
‘Me’ ‘Uncomfortable’ ‘Someone | know’ 
70%/30% ae 62°%/38% 
Don’t like Photo Said mean Won’t leave alone Threat 
72%/28% | 70%/30% 60%/40% 60%/40% 95%/45% 


| /_f \ 


Msg Unfriend Block TrMsg 


Category breakdown 


| pesca 


Just don’t like (77%) ¢ Photos: Awk pics, screenshots, vs photos, tag besties, 
spam 
¢ Text: call out person, relationship post, tag besties 
Posted a photo that makes me « Mosily bad (candids, funny face) 
uncomfortable (17%) ¢ Screenshots, porn, relationship, making fun 


Said mean things (5%) ¢ Photos: Tag besties, political, vs photos, screenshots, 
joking/mean comments 
¢ Text: family conflict, fights, passive aggressive posts 


Won’t leave me alone (9%) ¢ Screenshots, vs photos, soam 
¢ ‘Pestering’ as opposed to ‘stalking’ 
Threatening (4%) ¢ Photos: Bad photos, vs photos, screenshots, soam 


¢ Text: rating girls (top ten), harassment 


The new Report Flow (v 1.1) 


What do you want to do? 


siendanueabn denen For those who picked ‘posted 
Let Summe ses now that his s photo makes you uncomfortable and that something that [ just don't like’ 


osted and | really don't like it. Can you please take it - 60% send msg 


The new Report Flow (v 1.1) 


For those who pick ‘threatened 
to hurt me’: 


What do you want to do? 


We care about your safety. No one has the right to physically threaten you. ° . GO 
Please get help from a trusted friend, adult, or an authority figure 4 What Yo block: 6 Yo 
immediately. 


Block Summer Huff - What % unfriend: 3% 
You and Summer will no longer be able to see each other or connect on 
Facebook 


- What % choose trusted msg: 11% 


Get help from a trusted friend, adult, or an authority figure 


Let someone know that Summer's photo makes you uncomfortable and - What % end up sending msg: 14% (2% 
you want help. overall) 
| Ce) a fo) 
| Continue —— What % cancel: 22% 


- What % choose no option: 27% 


- What % navigate away: 31% 


The new Report Flow (v 1.1) 


- For users who picked ‘said 
mean things to me’ / ‘won't 
= hese andegt nso aeesiigacee you feel. Please choose how much leave me alone’ / ‘posted a 
Sad: not atall ( )a little extremely photo that makes me 
Nervous: ( )notatall ( )alittle (| _) extremely uncomfortable’ 


How does this make you feel? 


Afraid: not atall ( ja little extremely 
Angry: notatall ( ja little extremely 
Embarrassed: not atall (| ja little extremely 


- What % completed overall: 85% 
- What % completed that were forced: 96% 


Continue hk - What % completed that were unforced: 
73% 


Distribution of emotions 


a el 


No answer 27% 30% 30% 24% 25% 
Not at all 42% 42% 46% 35% 30% 
A little 11% 10% 9% 12% 16% 
Very 5% 5% 4% 10% 8% 


Extremely 13% 12% 10% 19% 21% 


‘said mean things’ 


No answer 28% 30% 30% 24% 26% 
Not at all 26% 35% 36% 19% 24% 
A little 14% 12% 11% 8% 11% 


‘won't leave me alone’ 


Sia el a 


No answer 34% 40% 37% 32% 37% 
Not at all 41% 40% 41% 33% 37% 
A little 9% 7% 8% 11% 9% 


Very 5% 3% A% i 
Extremely 10% 9% 9% = 13% 


‘posted a photo that makes me uncomfortable’ 


Se a eel 


No answer 24% 26% 26% 22% 19% 
Not at all 46% 44% 50% 40% 27% 
A little 12% 12% 10% 14% 20% 


Extremely 12% 12% 10% 17% | 


The new Report Flow (v 1.1) 


For those who complete emotion 
What do you want to do? slide: 


We care about your safety. No one has the right to physically threaten you. 
Please get help from a trusted friend, adult, or an authority figure 


- What % block: 7% 
immediately. 


ee - What % unfriend: 6% 


You and Summer will no longer be able to see each other or connect on 
Facebook 


- What % choose trusted msg: 14% 


Get help from a trusted friend, adult, or an authority figure 


Let someone know that Summer's photo makes you uncomfortable and 


- What % end up sending msg: 24% (3% overall) 
you want help. 


- What % cancel: 9% 


- What % choose no option: 11% 


- What % navigate away: 53% 


Comparing Old and New Flows 


- Were users more or less satisfied with the new report 
flow? 


One concern was that kids would be less satisfied with the new flow 
compared to the old flow because the new flow was longer 


There were no significant differences 


New Flow Old Flow 
How easy? 1.89 1.92 
How helpful? 2.23 2.18 


How comfortable? 2.23 2.17 
How satisfied? 2.19 2.22 


Comparing Old and New Flows 


- Did we change actual behavior? YES! 


- Of those who completed the report (for more extreme instances), a greater 
number of users in the new flow reached out to a trusted adult 


New Flow Old Flow 


Reaching out to 43% 19% 


trusted adult 
Blocking 28% 44% 


Comparing Old and New Flows 


- Two-days later: Was the trusted adult helpful? 


- Trusted adults were perceived as being more helpful in the new 
versus old flows (Ns are small; more data necessary) 


New Flow Old Flow 


Was the trusted 2.08 2.47 
adult helpful? 


(lower number means more helpful 1-4 scale) 


Next steps 


- Tweak v1.1 and release v2. 
Have fewer cancelations 
Get more children to reach out to trusted adult (or friend) 
Provide even more specialized help to youth who are in danger 
- Analyze data more carefully; publish findings 
Categorical analysis: Do reported posts map onto categories 


Dive deeper into each category. Some numbers are alarming (e.g., physical threats). More 
categories likely are necessary 


Learn more from kids about what they need to navigate their lives online 
- Start helping older age groups 
¢ Build a comprehensive help center for teens and parents 
- Prevention is the key! 


Let’s Imagine... 


Thank you! 


Today we are faced with the preeminent fact that, if civilization is to 
survive, we must cultivate the science of human relationships... the 
ability of all peoples, of all kinds, to live together, in the same 
world, at peace. 
Franklin D. Roosevelt 
1945 


Relationships Matter! 


